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ABSTRACT ^ ^ 

I An investigation of norry and emotionality as 
different components of test anxiety is presented through a 
longitudinal study of subjects in grades 6 and 9« The study aimed at 
describing and explaining the development of school^related anxiety^ 
dissatisfaction and the perceived learning environment. By 
confirmatory factor analysis tilth boys and girls independently^ the 
separation of norry and emotionality as test anxiety components 
proved successful.. The Test Anxiety Inventory (TAI) $ a self*-report 
scale designed to measure Individual differences in test anxiety as a 
situatlon*speciflc traits vas used In the study* The instrument 
proved to be promising as a reliable and content valid measure to 
assess cognitive and emotional facets of dispositional 
situation-specific test anxiety, (Author/GK) 
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Worry and E/notionality as Separate Components in Test Anxiety 

The assessment or" test anxiety has been influenced by certain theoretical 

aavances in this field during the last decade* The cognitive orientation 

in psychology has le&d to more insight into the process of anxious fnrousal 

in evaluative situations* I* Sarason (1960,1975) suggested that stress 

elicits a tendency to worry about possible failure and to direct more 

attention to self-related thoughts* The direction of attention hypothesis 

claims that highly test-anious individuals turn their task-relevant cognitions 

into task*irrelevant cognitions as soon as the situation is appraised as 

threatful (Hne 1971, 1980}*^ In test situations the evaluation of one's 

performance can be appraised as a threat to self-esteem. Highly test-anxious 

indivioua]^ are concerned with possible failure and self-doubts [Heckhausen 
> 

1980)* They worry about their performance and direct their attention to the 
self as actor instead of to -^he task at hand* This cognitive component of 
state test anxiety is responsible for the debilitating effect of anxiety 
on acadenic achievement* Autonomous arousal on the other hand seems to be 
less important in affecting the outcome in evaluative situations. 

Measures of test anxiety often do not measure exactly what their name 
denotes* Cognitive and emotional components of anxiety are confounded. There- 
fore it is hard to demonstrate the specific achievement debilitating impact 
that is due to the cognitive component only, Nicholls (l976) has shown that 
some of the items of the Test Anxiety Scale for Children (TASC) can be 
clustered together as a homogeneous subset which measures poor self-evaluation* 
This is in line with the suggestion of Liebert and Morris (19*37) who see 
test anxiety as composed by v/orry end emotionality. The worry component 
refers to cognitions which include concerns abou^erformance, poor self- 
devaluation, and consequences of failure. 'T^^e worrying individual does not 
feel confioent about his competence, thinks how much brighter others are, 
and perceives himself as more vulnerable toward failure. These cognitions 
ere represented by worry items, whereas emotionality items refer to affective* 
-physiological arousal which is experienced by the person in evaluative 
situations. Emotionality is not the arousal it^self but the sutijective perceoti 
of -such internal events, Bnotionelity items include the beat of the heart, 
the upset stomach, nervous feelings, uneasiness and so on* >Ve&sures designed 
to'assess worry and emotionality are reported by Wlorris and Liebert (l970), 
Bpielberger et el* (1978, 1980) and Oeffenbacher (1960),- 
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In a review of the literature Deffenbacher (1980) concluaes that the 
worry-emotionality distinction has been proved useful in psychological 
research during the last decade* The separation of these two corponents 
has to been seen relatively because they are not orthogonal* The author 
reports correlation coefficients between r^*55 and r=-75, indicating a 
moderate to high relationship between worry end efnctionelity that can be 
sesn as a compromise of convergent and discriminant validity- From a 
theretical point of view the components should assess different facets 
cf anxiety, that i^, they should be correlated- Cn the other hand this 
correlation should not be too high in order to debsct valid.ly the 
cognitive vs* emotional mechanisms in state anxiety- The covariation 
should be less than what is usual between congeneric tests* In several 
studies Deffenbacher (1960,116) has detennined the correlation between 
academic perfonnance and the two aspects of anxiety- The coefficients 
linking achievement and emotionality were from *07 to -26, the coefficients 
linking achievement and worry from *26 to *36* This different relationship 
is consistent with the theory and lends confinnation to previous studies* 
More impcrtant is the stability of these relationships* 9y partial correlati' 
analyses it could be shown that^j^stayed to be correlated with perfonnance 
when emotionality was partialed ' out* Worry consistently formed a negative 
relationship with test perfonnance whereas the findings for emotionality 
were rather inconsistent* The author also reports some moderator effect 
,of the cognitive component* At low levels of worry for example, emotionality 
did not debilitate test perfonnance, but at high levels cf worry it did- 
Th© reverse was true in' another study* Further research is needed to clarify 
the contradictions of such findings* 

The above mentioned empirical results support the assumption that in 
evaluative situations highly test-anxious individuals direct their attention 
partly away from the task toward self-related topics which in turn leads to 
a debilitating effect on intellectual perfonnance- The opposite assumption 
that autonomous arousal is primarily responsible for a disorganized 
activity seems to be without sufficient empirical confinnation* But a remark 
of caution is necessary* Einotionality and physiological arousal do not mean 
the same construct* Emotionality is the perception of experienced arousal 
by the individual > that is, subjective arousal which is only moderately 
correlatecj with objective arousal* Morris and Liebert [1970) found a 
correlation of rs=*34 for this relationship- This has to be considered in 
interpreting findings based on self-reported worry and emotionality* 
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Another point is the limitation of most findings to state anxiety, not 
trait anxiety* The concept of worr/ and emotionality has been originally 
formulated with respect to test anxiety as a state* Oeffenbacher (1980, 12a) 
concludes that, although both components separate out as elements of state 
anxiety, they may cluster together as elements of trait anxiety* Fortunately, 
the research of some other authors focusses now on worry and emotionality 
as components of trait anxiety too* Spielberger et al* (1978) have developed 
a new instrument called Test =..nxiety Inventory (tAI) that allows for a total 
score as well as two separate scores indicating worry and emotionality*"*** it 
is not possible to classify the test anxiety scales definitely as either 
measures of A-Trait or A-State, but the bulk of the evidence is consistent 
nevertheless with the assumption that test anxiety is a pituatiof>-specific 
measure of anxiety proneness (A-Trait) in test situations" (Spiislberger et al* 
1978, 186)* The correlation" between the two components was r=*71 for males 
and r=:*54 for females, which can be seen as a desirable relationship* Hodapp 
(1980) has used a German translation of the TAI in a study with 13a students 
in grade 7* He reports a correlation between worry and emotionality of r=:*a2 
for males and r=*46 for females* He also reanalysed some data from Spielberger 
and found a relationship of r=:*65 for m^les and j:^=*S6 for females* The author 
applied causal analysis techniques to his data and detected very inter^asting 
complex linkages with A^tate, ^T rait and achievement* J'Jorry was connected 
with A-Trait C*^7]t A-State was predetermined by A-Trait (^3^)^ worry [*18) 
and emotionality (*2a)* Achievement was predetermined by intelligence (*33), 
worry (-*27) and not by emotionality (*02)* This is in line with previous 
results* The worry and emotionality subscales seem to work as separate 
measures of di3posi1:ions indicating a situation-specific tendency to be 
concerned with one's own performance and to be aware of one'^s own physiologies 
arousal* 

Method 

Instrument 

In our study we used the Test Anxiety Inventory (TAl)* The TAI is a recently 
deveiopbd self-report scale that was designed to meestjre inciividucl differenc^^ 
in test anxiety as a situation-specific trait (Spielberger 1960), It consists 
of 20 items which are to be responded by using a four^point rating-scale 
format* In addition to a total score, separate scores for worry ano emptione- 
lity cqh be obtained* fhe^e are two 8-item subscales for this purpose* The 
f.c- Irs --re Intern^illy consistRnt which is demonstrated by median alphas of 
, B cinc .X, ref^pDutdvely. f^paelDt-rgLr and nis collaborators have? ^ep r^tad 



the two components by exploratory factor analysis using varimex rotation* 

f 

The 6 items or the worry subscale had higher loadings on tne worry factor 

^ compared to their loadings on the emotionality factor* The reverse was true 

' for the emotionality items* -^-^ 

The German version^ which was de\'Rloped by Hodapp, Laux & Schaffner (1979)^ 

1 

is still a preliminary version* It is designed to assess the two components 
that are represented by 10 worry items and also 10 embtionalit-y items* One 
aim of our study is to validate this instrument by finding an empirical 
solution which yields clear-cut subscales for worry and emotionality* The 
German authors have already conoucted some studies with large ssmples and 
the/ report positive findings concerning factor structure. and internal con- 
sistencies (not yet published)* The authors prefer oblique rotation within ' 
an exploratory factor analysis approach whereas^ we prefer confirmatory 
factor analysis* This difference in statistical approach makes is worthwhile 
to report our findings* 

Oata Collection and Sample 

The context of our investigation is a longitudinal study with 2000 subjects 
which is aimed at describing and explaining the development of school-related 
anxiety, dissatisfaction and the perceived learning environment* For the 
second point in time, in September-'^nd^Cctober 1960, we enriched our instru- 
ments by adding the TAI to the otheV variables* We are in need for a separate 
worry measure that could help to explain the growing tendency of evaluation 
anxiety, helplessness, and self-doubt in some subsamples* The instruments 
were given to 1,848 students until now, attending grades 6 and 9* 763 males 
and 811 females had no missing values and serve as independent samples in 
the present context* The data were collected during school lessons in 4 
types of school, representing different levels of academic achievement* 
The data were first analysed for females only, leaving the males as a 
sample for replication purposes* 

- Analyse s 

Tho most sophisticated method today which can be used to describe an explicit 
set of theoretically relevant dimensions is confirmatory factor analysi s, 
(Bentler 1980, Joreskog & Sorbom 1978,1979, Kenny 1979), This is a kind of 

I am grateful to the authors for having the opportunity to uss thjsir pre- 
liminary version 4 A of the German TAI 
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iuulti\/ariate analysis with latent \/ariables using structural equations. 
It is not" used as a data exploration method but as a hypcthesis-testing 
method- The dimensions are defined in ad\/£nce with respect to theoretical 
reasons and pre\/ious empirical results- In our study, worry and emotionality 
are' defined as latent variables which are linked each with a set of 10 
congeneric items- Every item is detained as an observed variable containing 
two kind^ of variance, common variance by a causal dimension and error 
variance due to unmeasured and unknown factors- The model can be specified 
in different ways depending on the hypotheses* For our problem it was 
necessary to allow for a correlation between the two factors* On the other 
hand, the errors of the observed variables were not allowed to correlate 
with each other* Each item was specified as having one loading* This implies 
that the .corresponding loading on the other factor has to be zero*The main 
question in confinnatory factor analysis is whether the model fits the data- 
There are two indications to answer this question* A chi-square value infonns 
about goodness of fit* Unfortunately, with large samples this value almost 
'never leads to a good fit* The problem^ is discussed by Bentler (1960, 428)* 
The LISREL IV program^ which we used^ delivers another indication of goodness 
of fit, that is the matrix of residuals* It infonns about the precision 
of the reproduced correlation coefficients compared to the input matrix* 
A rule of thumb says, there should be no residual coefficient greater than 
* 10* If the fit is satisfying the attention can be directed to the parameter 
estimates* CESREL yields maximum likelihood estimates of the factor loadings 
and all other parameters that are specified as free, for example the inter- 
correlation of the two dimensions- To summarize, our first aim is to find 
a model with a satisfying fit to our data* This would mean a confirmation 
of the hypothesized separation of worry and emotionality* The resultican be 
compared to a single factor solution that should have a worse goodness of fit- 
Second, we want to learyi about the parameter estimates, that is the factor 
loadings as well as the correlation between the two latent variables* Finally, 
the same procedure with the valid model is conducted with the replication 
sample- 
There are many studies in test anxiety using exploratory factor analysis * 

For reasons of comparison and familiarity our final set of items has to 

2 

undergo an exploratory factor analysis with varimax rotation- An acceptecJ 
LISREL solution should correspond with a clear pattern in this kind of 
analysis- In addition, 3ome further information can be obtained (eigenvalues, 
sampling adequacy)* 

^ JFACTGR program with maximum likelihood estimation (available in SPSS) 
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The third method that is appliea to demonstrate the separation of worry and 
emotionality is smallest space analysis (SSAl)* This is a nonmetrical 
technique of multidimensional scaling. The results are depicted in a space , 
diagram which informs about the distances of each item from the centroid and 
the distances of all items to each other within a 2-dimensional frsjneworK* 
A coefficient of alienation serves as indication of goodness of fit* It 
should be smaller than *15* 

These steps are completed by a traditional item analysis . If all four approacht 
give meaningful co ,sensus information we can conclude that there are .two 
reliable dimensions within test anxiety as a situation-specific trait* 

Re sults 

Confirmatory Factor Analysis 

The first analysis with 10 items for each factor has not been satisfying* 
The next step was done after eliminating one item on each facto:^'- This 
IS-item solution yielded a satisfying fit but was unfortunately connected 
with 5 correlation of *85 between worry and emotionality as latent variables* 
The mistake was to eliminate typical extremely located worry and emotionality 
items end to leave a pool which containea some mixed ?.tems measuring worry 
as well as emotionality* Two nearly parallel scales had been created by this 
mistake*. Finally, after eliminating four worry items and one emotionality item 
we found a satisfying 16-item solution* The final chi-squcre value of 244*7 
with 89 df was still too high (p = *00 ) dependent on the large sample 
{N ^ 811)* With N ^ 100 thei^ would have beed 29*3 (p = 1*00) which even 
would lead to an overfit* More important when using large samples is the 
matrix of residuals that is the difference' between the input correlation 
matrix and the matrix of the reproduced correlations* Out of IDS coefficients 
only two exceeded the *10 limit* Therefore we accept this solution* A single 
factor model did not fit the data* This was detected by fixing the correla- 
tion between the two latent variables to^SI (2,l) =1 vi;hich resulted in a 
much higher^ "^1,6 [for N = lOD) , resp. X = 585.7 (n ^ 811, df = 90)* 
The difference between the chi-square values was highly significant* The 
model specification and the parameter estimates are depicted in figure 1* 
As can be seen, worry and emotionality factors correlate *67, The loadings 
are sufficient and meaningful* They are lower foi' worry connected with more 
error variance for this dimension, 

SSA1 program (available in SPSS). All procedures were calculated at the 
computer centsr of the Technical University Aachen BWTH 
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The final model was also applied to the replication sarple of males. Again, 

a chi-square value of 2l7with 69 df was too high ( p ^ ,G0 ^) , due to the 

sample 'Size of N = 763* With. N = 100 the )[f would have been 28.2 [p = 1*00)* 

The reproduced cbrrslation matrix was satisfying* Only four out of 105 

f 

residuals exceeded the,*10 limit* Therefore the model is successfully replicate 

The parameter estimates are depicted in fi^re 2* Wforry and emotionality 
dimensions are correlated moderately [jS^V)* This is a remarkable difference 
to the girls* The factor ladings, too, are lower than for the original sample* 
This is connected with a lower amount of explained variance* In our model 
the squared loadings are identical to the communelities* Th^ aver^^e of the 
communalities is the explained variance (see tables 1 and 2)* 
The two subsamples show differences in several parameters* The accepted 
/l6-item model does not work with boys the same way as with girls* This is 
a point for further research* Sex differences in general have to be taken into 
account* But the formal replication of the specified model was sucpessful* 
Only this is our concern in the present context* 

1 r 

Exploratory Factor Analysis ^ ■ 

As a second step, in order to provide with comparable end familiar inforoation, 
we have calculated a maximum likelihood factor analysis with varimax rotation* 
The measure of sampling adequacy was above *90 for both samples* The results 
for the girls are , summarized in table 1* Only two eigenvalues are greeter than 
1* 45 ^ of the total variance is due to the factors, 33 % td emotionality and 
T to worry* The correct loadings for worry vary from *45 to *63, the loadings 
for emotionality vary from *53 to *75* They are similar to the LISPEL estimates 
There is no doubt about the factor structure* Each high loeding is exactly 
ibcated on the dimension towhich it belongs theoretically* This is illustrated 

by figure 3* The six worry items cluster together, and the 3 emotionality items 

\ 

do even better so* \ 

The results for the boys are summarized in table 2* Cnly two eigenvaltjes are 
greater than 1* 37 ^ of the total variance is due to the factors, 29 to 
emotionality and 8 to worry* The correct loadings for worry vary from *45 
to *5S, the loadings for emotionality frcr^ .51 to .71 which is similGr to 
LI3REL estimates* Agein, each high loading is precisely located '.vhere 
it has to De* This is "illustrated by figure ^* Worry and emotionality turn out 
to represent sepernte clusters*- 
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Table 1: R^^sults of exploratory factor analysis compared to confirmatory 
of girls ( N » 811 ) 
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EXPLORATOHV FA 




CONFIRMATORY FA 




Number 


WORRY 


EMO 




WORRY 


EMO 




1 


.45 


.16 


.23 


.47 




.22 


2 


.18 


.59 


.38 * 




.61 


.37' 


3 


.50 


.28 


.33 


.60 




.36 


4 


.16 


.53 


.31 




.55 


.30 


5- 


.48 


.30 


.33 


.59 




.35 


.6 


.29 


'.63 


.48 




.69 


.48 


7 


.29 


.67 


• 5^ 




.73 


• 5^ 


e 


.63 


' ' .13 


.41 


.59 




.35 


V 


.63 


.12 


.41 


.58 




.34 


10! 


^ .26 


;7s 


.63 




.80 


.63 


1 1 


.23 


.74 


• Ol 




.78 




12 


.20 


.66 


.48 




.69 


.48 


13 


.2? 


.;73 


.61 




.78 


.61 


14 


.53 


.30 


.37 


.62 




.39 


IS- 


.e? 


.74 


.61 




.78 


.61 


EIGENVALUE 


1.57 


6.26 










VARIANCE 


6.6 i> 


3(6.2 % 


44.6 7t 
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Table 2 ; Results of exploratory factor analysis compared to confirmatory factor analysis in the replication sample 
of boys ^ N « 763 ) 7 1 



X/Ctl XOwXC 

Nunber 


EXPLORATGRY 
■;ORRY 


FA 

mo 




CONFIRMATURY FA 
V^GRRY mo 




1 


.52 


.03 


.27 


.47 


• 22 


2 


.18 


.52 


.30 


.55 


.30 


3 


.56 


.17 




.58 


.34 


4 


.07 


.51 


.27 


.51 


.26 


5 


.45 


.25 


.26 


.52 


.27 


6 


.28 


.51 


.33 


.57 


.32 


7 


.?2 


.63 . 


.45 


.6? ^ 


. .45 


8 


.53 


.13 


.29 


.55 


.30 


9 


.58 


.12 


.35 


.57 


.33 


10 


.23 


.71 


.56 


.75 


.57 


11 


.08 


.67 


.46 


.66 


.43 


12 


.10 


.62 


.39 


.62 


.38 


13 


.21 


.70 


.5A 


.73 






.47 


.30 


.26 


.52 


.27 


15 


.21 


.64 


.46 • 


.66 


.4fe 


EIGENVALUE 


.1.13 


4.41 










7.5 % 


29.4 


36.9 % 
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Figure 3 ; Variraax-rotated factor structure, for the female sample 
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Figvjre 4 : Variinax-rotated factor structure for the male sample 
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Smallest Specs Analysis 

Nonmetrical twodimensional scaling yieldacJ results that are in lins with the 
above reported findings* Fr.*" girls the coefficient of alienation (*13) 
indicates a satisfying goooness of fit* The space diagram illustrates the ^ 
successful separation of worry and emotionality itemS(figure 5) , ^ 

For boys the coefficient of alienation is .12* The space niagram shows a 
high degree of similarity to the girls for the horizontal axis ^ (figure 6}* 
In both diagrams the emotionality items are more homogeneous- They cluster 
together whereas the worry items display a more heterogenecus pattern* 

Item Analysis 

Finally, a traditional item analysis was performed yielt'ing sufficient 
internal consistencies for enfbtionality (-91 for girls, *86 for boys) 
but rather low alphas for worry (*75 for girls, *7lVor boys), a fact that 
may be also due to the reduced number of it'ems* Overall, tnerfe is no 
corrected item-total correlation coefficient lower than *40 (cf- table 3}* 

Cone lusion 

The separation of worry and emotionality as different components of test 
"anxiety has been proven ^successful* 8y' confirmatory factor analysis with 
girls and boys independently, worry was , linked to 6 items, emotionality ta , 
9 items consistently* The two dimensions were correlated *67 in the female 
sample, and *S^V in the male sample- ^^Traditional factor analysis , ^smallest ■ 
space analysis and item analysis have been able 'to confirm and enrich the / 
findings*The emotionality dijnension turned out to be more substantial* It 
exhausts 'a greater amount qif total variance, shows considerably low error 
terms, clusters nicely together and is internally very consistent* This is 
especially true for girls* 

On the whole, the instrument Can now be used as a reliable and content valid 

measure "to assess cognitive and emotipnsl facets of dispositional situation*- 

••specific test anxiety* But it is ^still possible to improve the worry subscale. 

There is empirical evidence that this dimension could be Improved tjy adding 

more it^s which may be similar to the present item pool* This could lead 

to a greater amount of explained variencej to higher factor loadings, to 

a less heterogeneous clustering and to a strengthened internal consistency- 

The TAX is a very, promising -instrument- M are sure that it will hav.e a 
significant impact on test anxiety research in Germany, too* 



eric; 



IS 



0 



\ 

\ 



0 



® 



19 



0 



® 



© 



_1 



10 

1513 II 



12 



UO 



20 



13. 12 
15 

10 U 



Table 3: Item analysis of the worry and the emotionality subscales for females and males 



Number of 






WORRY 








E M 0 T 


I 0 N A L 


I T Y 




Item Variable 




bXHLo 






oUto 










DlJYb 








X 






X 




^Hi- 
lt 


X 


IT, 






It 


02 


1 


^* DO 




.40 


2.72 




/in 












D3 


2 














1 • bb 




1 .45 




.51 


C6 


3 


O OQ 




.51 


2.26 




/I A 












06 


4 














1 • tjtj 




1 • J 1 






08 


S 


t • u/ 




.46 


2.11 




.*4 1 












10 


6 
















• OO 


1 . o/ 




C4 
. Ol 


13 


7 














2. 2/ 


on 
• /u 


1 .y2 




.o2 


14 


8 






.52 


2.11 




• U/ 












15 


9 






.52 


2.43 
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1 fl/i" 
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Aft 


16 


11 
















OR 
• /O 






A4 


21 , 


12 














1.53 


.66 


1.44 




.36 


24 


13 






* 








1.70' 


.75 


1.S7 




.68 


23 . 


14 


2.46 




.50 


2.46 
















27 


15 - 














I.B? 


■ .- .75 


1.64 




.64 


Oronbach's Alpha 


.75 




4 


.71 






.91 ' 




.86 


-1 
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